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Abstract 

Topological invariants are conventionally known to be responsible for protection of extended 
states against disorder. A prominent example is the presence of topologically protected extended- 
states in two-dimensional (2D) quantum Hall systems as well as on the surface of three-dimensional 
(3D) topological insulators. Distinct from such cases, here we introduce a new concept, that is, 
the topological protection of bound states against hybridization. This situation is shown to be 
realizable in a 2D quantum Hall insulator put on a 3D trivial insulator. In such a configuration, 
there exist topologically protected bound states, localized along the normal direction of 2D plane, 
in spite of hybridization with the continuum of extended states. The one-dimensional edge states 
are also localized along the same direction as long as their energies are within the band gap. This 
finding demonstrates the dual role of topological invariants, as they can also protect bound states 
against hybridization in a continuum. 



Bound states of electrons in solids offer many intriguing phenomena. For instance, lo- 
calized states are common in the presence of impurities, and donor and acceptor levels are 
the main issue in semiconductor physics and technology. Bound states can also appear in 
clean systems and their existence attributes to topological origins in many cases. Solitons in 
polyacetylene are associated with the midgap states which emerge due to topological reason, 
and control the electric, magnetic and optical properties of the system.^^ One dimensional 
(ID) conducting channels at the edge of the quantum Hall and quantum spin Hall system 
are another example of bound states in clean systems, which determines the low energy 
transport phenomena.^ ^ Bulk-edge correspondence guarantees the existence of these edge 
channels, i.e., they are protected by the gap and the nontrivial topology of the bulk states.'^'^ 
A recent remarkable advance in the study of three dimensional topological insulators, which 
support the helical Dirac fermion on the surface of the sample, provides another example of 
bound states belonging to the same category.l^^^ 

A common feature of all these cases is that the energy of the bound state is within 
the energy gap of the extended states. The extended states constitute the continuum of 
the density of states even though the disorder potential makes the crystal momentum k 
ill-defined. Usually the extent of the localized state is determined by the inverse of the 
energy separation between the localized level and the edge of the continuum. In general, 
it is believed that no state can be localized within this continuum due to the hybridization 
with the extended states, as discussed in detail in Supplementary Note 1, although there 
are several proposals for creating a bound state in a continuum by engineering the eflFective 
coupling between the discrete level and the continuum states.'^^HIZl This fact is the essential 
reason for the existence of the mobility edge Ec in disordered systems.!^ Namely, there is a 
critical energy Ec separating the extended and localized states. 

In this paper, we study the electronic states of the 2D quantum Hall insulator (QHI) on 
the substrate of a topologically trivial 3D normal insulator (NI). One remarkable discovery 
through this study is that there are bound states even in the continuum of the Bloch states 
of the substrate. The hybridization with the Bloch states does not destroy the localization 
of some bulk states of the QHI along the z-direction perpendicular to the surface. This is 
the first example for the existence of bound states within the continuum of extended states, 
which are protected by the topology. 
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Results 



Structure of the system. A schematic diagram describing the structure of the system 
is shown in Fig. [T^. We first consider a 2D QHI supporting ID chiral edge states (CES) on 
its boundary and a fuUy gapped 3D NI separately and then put the QHI on the top surface 
of the 3D NI. As shown in Fig. [T)3-c, the typical band structure of the coupled system is 
composed of three inequivalent parts, i.e., the 3D continuum states from the 3D NI and the 
2D bulk and ID CES from the QHI. There are two main questions to address here. One 
is whether the 2D bulk states of the QHI are exponentially localized near the top surface 
layer or they are spread out along the z-direction when the 2D QHI and 3D NI are strongly 
hybridized, especially, when the 2D QHI bands are fully buried in the continuum of the 3D 
NI bands. The other is what the spatial distribution of the ID CES is along the z-direction 
in this case. These two issues are closely related because if the 2D states are extended and 
diluted along the z-direction, it is natural to expect the CES to be extended and diluted, 
as well. As for the fate of ID chiral states coupled to a continuum, it is reminiscent of a 
recent theoretical work demonstrating the stability of the helical surface states of topological 
insulators against the hybridization with additional non-topological bulk metallic states.'^ 
However, it is worth noting that the stability of ID chiral states in our system is essentially 
a new issue because when the 2D QHI is coupled to a 3D substrate, even the stability of the 
2D QHI bulk state itself supporting the boundary chiral fermions is not guaranteed. 

To understand the eflFects of the hybridization between the 2D QHI and the 3D substrate, 
we first study numerically a hexagonal lattice system composed of stacked 2D honeycomb 
lattices as shown in Fig. [T]l. Here we treat the 3D NI as a system composed of coupled 2D 
layers stacked along the z-direction, where each layer is labeled with the index = 1, A^^. 
The top layer labeled with = represents a 2D QHI, which is coupled to the 3D NI through 
the inter-layer hopping transfer between nearest neighbors. The detailed description of the 
lattice Hamiltonian is given in the Methods section. 

Localized state in a continnum. In Fig. [2| we plot the energy dispersion along the 
fca^-axis and the localization profile of the system. From Fig. [2^ to Fig. [2]3, the energy gap 
of the 3D NI is gradually decreased, while the other parameters of the QHI are fixed. Also, 
layer-resolved wave function amplitudes are shown in each panel. When the QHI bands are 
fully separated from the continuum as in Fig. [2^, the wave functions of the QHI are almost 
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completely localized in the first two layers. On the other hand, Fig. [2)3 shows that when 
the QHI and NI bands overlap in a finite interval, the parts separated from (touching) the 
continuum are localized (extended). However, surprisingly, the bound states still exist even 
when the QHI bands are fully buried in the continuum as shown in Fig. In Fig. [2]3, 
there is a window near the corner of the Brillouin zone, marked with dotted circles, in 
which bound states exist within the continuum states. Especially, in this case, the states 
at this corner of the Brillouin zone are completely localized, therefore their wave function 
amplitudes become zero within the accuracy of our numerics for ^ 5. In Fig. [2^-h, we 
plot the £z dependence of the squared wave function amplitude of the localized states at 
the two corners of the hexagonal Brillouin zone. To compare the wave function spreading 
at the two corners on the fc^^-axis, we have changed the strength of the inter-layer coupling 
between the top and its neighboring layers relative to the inter-layer coupling inside the 3D 
NI, which is defined as p. For given p and the momentum, we have picked one state, among 
the eigenstates, which has the highest wave function amplitude on the top layer. When the 
top layer is decoupled from the rest of the system, that is, when p = 0, there are completely 
localized states at both corners. However, when p increases to p = 0.5 and finally to p = 1.0, 
the state localized at the left corner spreads rapidly along the z-direction (Fig. [2}i) while 
the localized state on the right corner survives without any spreading of the wave function 
amplitude (Fig. [2^). The distribution of localized states in the Brillouin zone is refiected in 
Fig. [2]l-f in which the squared wave function amplitudes of the localized states on the top 
layer {i^ = 0) are plotted. 

Topological stability of the localized state in a continuum. In fact, remarkably, 
the bound state in a continuum has topological stability. Namely, the bound state always 
exists in the Brillouin zone and cannot be removed by applying small perturbations. It is to 
be noted that, as shown in Fig. [2} the lattice model we have considered has a 3-fold rotational 
symmetry (Cs) while all the other point group symmetries are explicitly broken. To rule out 
the symmetry protection of the localized state at the corner of the Brillouin zone, we have 
introduced a term breaking symmetry and confirmed that the localized state survives 
even when all the point group symmetries of the system are completely broken. In addition, 
the stability of such localized bound states is further supported by additional numerical data 
demonstrating that localized bound states always exist irrespective of the lattice structure 
and the nature of the inter-layer coupling between the 2D QHI and 3D NI. The detailed 



4 



information about the additional numerical results is provided in Supplementary Figure SI 
and Supplementary Note 2. 

The topological stability of the localized state can be understood in the following way. 
The minimal Hamiltonian for the 2D QHI and 3D NI, which describes one conduction band 
and one valence band with a finite gap between them, can be written as i^QHi(fc±) = h • t 
and H^i{kj_^ kz) = Hq + H • r where r = (rx^Ty^Tz) are Pauli matrices. Here /i is a function 
of the in-plane momentum k± = {k^^ky) while and H depend on the three momenta {kx^ 
ky^ kz). Considering the coupling between the 2D QHI and 3D NI, in general, the retarded 
Green's function for the effective 2D QHI can be written as 

^ r r 1 

G^{^) = Q-h-T + i- 1 + a^Tx + ayTy + a^r^ , (1) 

where T ^ when Q is within the 3D NI bands and F = otherwise. In Eq. ([T]), the unit 
vector a = i^i which + sign (— sign) corresponds to the case of Q lying within the 3D 

bulk conduction (valence) band. It is to be noted that here a and H depend on (f], kx^ ky). 
The kz dependence of H is replaced by the Q dependence through the kz integration in 
the self-energy correction. Also the minor correction from the real part of the self-energy is 
neglected, however it does not affect the generality of the conclusion. The detailed derivation 
procedures to obtain Gr can be found in Supplementary Note 3. Then DetG^^ = Q'^ — h'^ + 
ir{Q + a • h) = immediately leads to = —a • h = ±|/i|. Namely, when the unit vector 
a is parallel (anti-parallel) to /i, a Delta function singularity of Gr appears ai Q = —\h\ 
{Q = |/i|), which corresponds to the bound state and the localization along the z-direction. 

Let us discuss about the physical meaning of the condition a = ±h = In the case 

of the QHI with the Hamiltonian i/qni = h{k±) • the unit vector h forms a skyrmion con- 
figuration in the 2D momentum space and the wrapping number (or the skyrmion number) 
of h over the first Brillouin zone is equal to the Chern number of the QHI.^^ On the other 
hand, since H stems from the Hamiltonian of the 3D NI, generally, a = H{Q^ k±)/\H\ cannot 
have nonzero skyrmion number. Namely, the unit vector a describes a topologically trivial 
configuration. Figure [i] shows the orientations of h and a, in which h forms a skyrmion 
configuration with the unit Pontryagin number. It is to be noted that there are two special 
points, one at the center and the other at the boundary of the circle, where h = —a or 
h = d 18 satisfied, respectively. One of the two special points satisfies the condition for 
bulk localization, either in the conduction band or in the valence band. Therefore there 
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should be at least one localized 2D bulk state in each of the conduction and valence bands. 
The key ingredient leading to the topological protection of the localized bound state is that 
the points satisfying h = ±a cannot be removed as long as h and a describe topologically 
inequivalent configurations. In general, the number of completely localized states buried in 
a continuum band is given by Cf^ — Ca where Cf^ is the skyrmion number (or Chern number) 
covered by the unit vector h. 

Localization of ID chiral edge states. Now we turn to the localization problem of the 
ID CES. To observe the ID CES numerically, we have introduced boundaries with zigzag- 
type edges on each honeycomb layer. It is confirmed that in all three cases corresponding to 
Fig. [2^-c, the ID CES exists and is localized on the top few layers. Especially, as shown in 
Fig. [2]3 and[4| it is valid even when the QHI bands are fully buried in the continuum, hence 
a part of the ID CES is hybridized with the continuum states. However, the hybridization 
with the continuum states does not simply destroy the ID CES but instead the ID CES 
is pushed away from the overlapping region into the bulk gap, which is consistent with the 
recent theory proposed by Bergman and Rafael. The crucial point is that the existence of 
in-gap states is solely determined by the topology of i/gHi- Moreover, once the CES exists, 
the fact that it is in the gap guarantees its localization along the z-direction even if QHI 
bands are coupled to the continuum states. The detailed proof is given in Supplementary 
Note 4. Therefore as long as the gap between the conduction and valence bands of the QHI 
is not fully buried in the 3D continuum, the ID CES should exist and be localized. 

Extension to general cases. The topological protection of the localized bound states 
against hybridization is a phenomenon that is valid in more general situations beyond the 
simple two-band model description considered up to now. Here we provide additional nu- 
merical data supporting the generality of our theory. To construct general lattice models, 
we have modified the in-plane dispersion in the Hamiltonian of the 3D NI to lift its similar- 
ity to the Hamiltonian of the 2D QHI. The detailed structure of the modified Hamiltonian 
describing the 3D NI is shown in the Methods section. 

Let us discuss about the extension to multi-band systems. For simplicity, we construct 
2D four-band models attached to the two-band 3D NI. To distinguish the diflFerent Chern 
number distribution between the four bands on the top layer of the heterostructure, we use 
the following notation of C = [Ci, 02,^3, C4] where Ci indicates the Chern number of the 
i-th band. Here the four bands are aligned in decreasing order of energy from the band 1 
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with the highest energy to the band 4 with the lowest energy. 

We first consider the case of C = [0, 0, —1, +1]. Here the two high (low) energy bands are 
buried in the conduction (valence) band continuum of the 3D NI. From the 2D distribution 
of the states localized along the z-direction as shown in the two right panels of Fig. [5^, we 
can clearly see the different degrees of localization between the topologically trivial bands 
and non-trivial bands buried in a continuum. This is also supported by the layer-resolved 
wave function amplitudes. Interestingly, even when the two 2D bands with opposite Chern 
numbers are buried in a single continuum band, so that the gap between the 2D bands 
is filled with continuum states, each of the 2D bands supports completely localized bulk 
states separately. This shows the fact that the number of localized 2D bulk states is solely 
determined by the Chern number diflFerence between the 2D bulk band and the effective 2D 
band of the 3D NI, which is consistent with the conclusion based on the Green's function 
analysis given above. On the other hand, as for the localization of the ID CES, the existence 
of the band gap between the 2D bands supporting the CES is crucial. From the numerical 
analysis of the edge spectrum, it is confirmed that there is no ID CES localized along the z- 
direction in this case. We also have considered other model systems such as C = [—1, 0, +1, 0] 
(Fig. ^),C = [0, -1, 1, 0] (Fig. |5|:), C = [-1, -1, +1, +1] (Fig. |5|l), C = [-1, +1, +1, -1] 
(Fig. [5^) cases. All of them support the same conclusion that the localization of the 2D bulk 
state is entirely determined by the Chern number of the 2D band buried in the continuum 
states of the topologically trivial 3D NI. However, the existence of the band gap is required 
for the localization property of the ID CES in addition to the topological property of the 
2D bulk states supporting the ID CES. 

Next we describe the localization property of the 2D QHI with higher Chern number, in 
particular, when the Chern number of the conduction (valence) band is equal to -2 (+2). 
In this case, we expect that there should be at least two localized 2D bulk states in each 
of the valence or conduction band when each band is completely buried in a continuum. 
As shown in Fig. [6| we can clearly see that there are several localized states which are 
well-separated in the momentum space. In particular, along the boundary of the Brillouin 
zone, it is numerically confirmed that there are three completely localized states. Among 
them, two states are related by the refiection symmetry but the other one is not. Therefore 
there are at least two inequivalent localized states in the Brillouin zone, consistent with the 
prediction based on the consideration of topological invariants. 
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Finally, let us consider the localization property of the 2D quantum spin Hall insulator 
on a substrate. Since the QSHI can be considered as a superposition of two QHI systems 
possessing opposite Chern numbersplthe topological protection of the bulk and edge states 
is expected to be observed in the QSHI heterostructure. As for the topological property of 
the QSHI, it is important to clarify whether the z-component of the total spin, i.e., Sz is 
conserved or not. When Sz is conserved (not conserved), the topological invariant of the 2D 
system is the spin Chern number (the Z2 invariant). In addition, we consider two different 
model Hamiltonians for the 3D NI. One is the two-band model breaking the time-reversal 
symmetry and the other is the four-band model preserving the time-reversal symmetry. In 
the case of the two-band model on the honeycomb lattice, since there is only one available 
state in each site, it can be considered as a spin-polarized system breaking the time-reversal 
symmetry. 

As shown in Fig. [7^-b, when the 3D NI breaks the time-reversal symmetry, several local- 
ized bound states are found independent of the presence (Fig. [7^) or absence (Fig. ^)p) of 
the Sz conservation. On the other hand, when the total heterostructure maintains the time- 
reversal symmetry, the Sz conservation is crucial to obtain localized bound states. When 
the Sz is conserved, several completely localized bound states appear as shown in Fig. [7]3. 
However, surprisingly, once the Sz conservation is violated due to the Rashba-type spin- 
mixing term, all the 2D bulk states of the QSHI spread along the z-direction, as shown in 
Fig. [7]1. It is numerically confirmed that there is no localized bound state in the Brillouin 
zone. This observation demonstrates the fundamental difference between the Chern number 
(or spin Chern number) and the Z2 invariant. In contrast to the case of the Chern number, 
the nonzero Z2 invariant cannot protect any localized bound state in a continuum state. 

Discussion 

The existence of 2D bulk states localized along the z-direction in a continuum protected 
by topology reveals the dual role played by the topological invariant. Conventionally, the 
topological invariant has been considered as a quantity which protects the extended bulk 
states against the localization due to disorder. These extended bulk states protected by 
topology guarantee the existence of the delocalized states on the sample boundary even in 
the presence of disorder, which gives rise to the profound relationship between the bulk 
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topological invariant and the extended boundary states, dubbed the bulk-boundary corre- 
spondence. For example, in integer quantum Hall systems, the Chern number can be formu- 
lated in terms of the number of chiral edge modes.'^^^ Also, the Z2 invariants of 2D (3D) 
time-reversal invariant systems determine the parity of the number of helical edge modes 
(Dirac cones) at the boundary. These boundary states within the bulk band gap smoothly 
connect the bulk valence and conduction bands, which can be deformed and fully merged 
into the bulk bands only when the corresponding bulk topological invariant changes through 
the bulk band gap-closing. Namely, the pair annihilation of the topological invariants is the 
only mechanism to eliminate the extended states. 

On the other hand, when the topological insulator is coupled to a substrate material, 
the topological invariant also guarantees the existence of some bulk states localized along 
the z-direction, which are effectively decoupled from the continuum states of the substrate. 
In the case of the 2D QHI on a topologically trivial 3D NI, the Chern number of the QHI 
determines the minimum number of localized 2D QHI bulk states buried in the continuum 
states of the 3D NI. The essential ingredient leading to the localized 2D bulk states buried 
in a continuum is the inequivalence of the Chern numbers between the 2D QHI and the 
effective 2D system constituting the 3D NI. Therefore if the topological property of the 
QHI on the top layer can be controlled by tuning the bulk band gap of the 2D QHI, the 
completely localized states can start to be hybridized with the continuum states of the 3D 
NI across the topological phase transition and be spread through the whole sample in the 
end when the 2D bulk state on the top layer is deep inside of the topologically trivial phase. 

In addition, using the same framework, it is also possible to understand the evolution 
of the energy band structure of the coupled 2D QHI systems stacked along the vertical z- 
direction. Here we assume that the inter-layer coupling is not so strong to induce any band 
touching through the inter-layer hybridization. If we distinguish the QHI on the top layer 
from the other part of the system, the whole system can be considered as a heterostructure 
composed of a 2D QHI layer and a 3D QHI substrate. Since the top layer and the effective 
2D layer of the 3D substrate have the same Chern number, there can be no 2D bulk state 
that is localized on the top layer, which is confirmed through the additional numerical study 
discussed in detail in Supplementary Note 5 with figures shown in Supplementary Figure 
S2. In this case, the ID chiral edge states of the top QHI layer should also be delocalized 
and spread along the vertical z-direction. The extended ID chiral edge states eventually 
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participate in the formation of the boundary gapless states of the 3D weak QHI,^^ which 
disperse along the two orthogonal directions, one of which corresponds to the vertical z- 
direction-f^To establish the general relationship between the topological invariant of the 3D 
substrate and the localization property of the 2D QHI is an interesting problem requiring 
additional studies. 

Let us briefly discuss the influence of disorder. As shown above, the bound states expo- 
nentially localized along z-direction exist only at several discrete /c-points. Since the disorder 
scattering mixes the wavefunctions at different fc-points, it is expected that the bound states 
can be hybridized with extended states and hence delocalized along z-direction. Correspond- 
ingly, the delta-functional peak of the spectral function will turn into a broadened resonance. 
The edge channels, on the other hand, can be protected by the gap, and hence remain lo- 
calized along z-direction. However, these hand-waving arguments should be conflrmed by 
more careful analysis, which is left for future studies. 

We conclude with a discussion of candidate materials realizing the topological protection 
of localization. A recent LDA+U study has proposed that several pyrochlore iridates can be 
anti-ferromagnetic insulators with the all-in/all-out spin conflguration.^'' In this magnetic 
state, the [lll]-surface or any of its symmetry equivalents supports a kagome-lattice plane 
with a non-coplanar spin ordering. Since the spin chirality induced by non-coplanar spins 
can give rise to a QHI on the surface^^ while the bulk insulating state is topologically 
trivial, pyrochlore iridates are an ideal platform to realize intriguing localization phenomena 
protected by topology. 



Methods 



Lattice Hamiltonian of the stacked 2D honeycomb lattice system. In each honeycomb 
layer, in addition to the hopping amplitude t between nearest-neighbor sites, we take into account 
of two additional terms, i.e., the staggered chemical potential between two sublattice sites in a 
unit cell and the imaginary hopping amplitude Ago between next nearest neighbor sites. Explicitly, 
the Hamiltonian including \is and Ago can be written as 



-t 



(1 + cos ki + cos k2)Tx + (sin ki + sin k2)Ty 



+ 



jis — 2Ago(sinA:i — sinA:2 — sin(/ci — /C2)) 
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where Tx^y^z are Pauli matrices indicating the two sublattice sites and ki — + ^ky, k2 = 
— \kx + ^ky. In this Hamiltonian, when fig < 3\/3Aso {j-^s > 3\/3Aso), the system is a QHI (a trivial 
insulator).^ Here we take i7^^^o,Aso ^ model Hamiltonian for QHI. Also we use i7^^^Aso=o as a 
basis to construct a 3D NI by incorporating inter-layer hopping amplitudes. Then the Hamiltonian 
for the coupled system can be written as 

+ {W.(^o + 7;t,)^4+i + /i.c.}, 

where i7^^,Aso(k±; 4 = 0) = i7^^^o,Aso(k±) and i7^^,Aso(k±; 4 7^ 0) = i7^^,Aso=o(k±). For numerical 
computation, we choose Ago = 1, To = 3, = 0.3. t = 1 (t = 3.5) for 4 7^ (4 = 0). To control 
the energy gap of 3D NI we use /x^ = 20 for Fig. [2] (a), fis = 12 for Fig. [2] (b), /x^ = 7.5 for Fig. [2] 
(c). 

For the construction of general lattice models, we replace the basis for the 3D NI by the following 
Hamiltonian, 

^^NNN = fJ^^Tx + COS ki + COS k2 + cos(A:i - k2) Tz, (2) 

where t' is the hopping amplitude between next nearest neighbor sites. Here the hybridization 
between two sublattice sites fi' determines the size of the band gap. The Hamiltonian for a 3D NI 
can be obtained by stacking i^NNN along the z-direction. 

Existence of ID chiral edge state under hybridization. The influence of the coupling to 
the 3D continuum states on the existence of the ID chiral edge states can be considered in the follow- 
ing way. We flrst consider a decoupled 2D QHI described by the Green's function Gq^j(x, x'] ky] 
where x (ky) is the spatial (momentum) coordinate and Q is the energy. Let V(xo) be a local pertur- 
bation creating a boundary at x = parallel to the y direction. Then the system with a boundary 
can be described by the Green's function G^^\x, x'\ VC) which satisfles the equation x'\ VC) — 

Gq^j(x, x'\ Vl) + Gqhi(^5 ^o; ^VG^^^ix^^ x'\ VC) where the ky coordinate is omitted.1221 After simple 
algebra, we can show that G(^^(xo, x'; ^i) = |l/[l — Gq]jj(xo, xq; ri)l^]|GQHi(^05 ^) which leads 
to the following condition to obtain the edge state 

Det[l-Ggii(xo,xo;f^)y] =0. (3) 

Now we turn on the coupling to the 3D continuum state under which Gq^j promotes to Ggm 



satisfying Gqhi(^ + ^0^) = Gi^(fi), the retarded Green's function in Eq. Considering the local 
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potential V{xo) again, the condition to obtain an edge state can be derived simply by replacing 

The point is that when is within the bulk gap of 3D substrate 
Gqri = G^QHi because GR{ft) develops the imaginary part only when is within the 3D continuum 
states. Therefore the couphng to 3D continuum states does not affect the existence of edge states. 

Moreover, in the case of the zero energy edge state, the condition to obtain the in-gap state can 
be rewritten in terms of the thermal Green's function at zero Matsubara frequency G~^{i(^ = 0). 
Namely, Det[l — Q{xo^ xq; icj = 0)y] = determines the condition to obtain the zero-energy in-gap 
state. It is interesting to note the consistency of this result with the recent work proposing that the 
topological invariant of general interacting systems can be written in terms of the Green's function 
at zero Matsubara frequency.'^ 
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FIG. 1: Geometry and energy band diagram of the heterostructure composed of two- 
dimensional (2D) quantum Hall insulator (QHI) and three-dimensional (3D) normal 
insulator (NI). (a) A schematic diagram showing the structure of the system. A 2D QHI with 
one-dimensional (ID) chiral edge state is attached on the top surface of a 3D NI. One main question 
is whether the ID chiral edge state is localized or extended along the z-direction when 2D QHI 
and 3D NI are coupled. The typical energy spectra of the full heterostructure in the momentum 
space are shown in (b) and (c). The NI bands (QHI bands) are the states coming from NI (QHI) 
and the dispersion in the gap corresponds to the (possible) ID edge channel, (d) A hexagonal 

lattice model composed of 2D honeycomb lattices stacked along the z-direction. The QHI on the 

15 

top layer (l^ — 0) is coupled to the 3D NI composed of stacked 2D trivial insulator layers {£z 0). 




FIG. 2: Energy dispersion and distribution of localized states of two dimensional 
(2D) quantum Hall insulator (QHI) bulk bands in a continuum. Energy dispersion and 
the distribution of localized 2D bulk states of the coupled system composed of honeycomb layers 
stacked along the z-direction. Bulk band structure of the system along fc^ = is shown in (a), 

(b) , and (c) where the normal insulator (NI) bands and QHI bands are not touching, partially 
ovarlapped, and fully overlapped, respectively From (a) to (c), the energy gap of the NI band 
is progressively reduced while the spectrum of the QHI band remains the same. In each panel, 
the layer-resolved wave function amplitudes of are shown. Here ^^^^ n-th 
eigenfunction at the momentum k^. The localized bound states are almost completely confined 
within the first two layers. The dotted circles on the second figure from the left in the panel 

(c) indicate the localized bound states existing within the continuum states. In (d), (e), (f), we 

have picked up one state among all the eigenstates at each k^, which has the maximum value of 

l^nk^(^^ = 0)p, and then the resulting squared amplitude of li^^i^^i^z = 0)p is plotted over the 

entire Brillouin zone for systems corresponding to (a), (b), (c), respectively. Finally, in (g) and 

(h), the ^^-dependence of the squared wave function amplitudes k^(^^)l^ localized state 

is plotted for k^ = ^) (s) for k^ = (— 0) (h). Here we have varied the strength of the 

inter-layer coupling between the top and its neighboring layers relative to the inter-layer coupling 

inside the 3D NI, which is defined as p. For fixed p and k^, we have picked the eigenfunction which 

has the highest amplitude on the top layer and plotted its £z dependence. 
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FIG. 3: Topological origin of bulk localization. Schematic figures showing the topological 
structure of the unit vectors h and a in a 2D space, h forms a skyrmion configuration with the 
unit Pontryagin number while a makes a topologically trivial structure, h and a are parallel 
(anti-parallel) at the boundary (at the center). 
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FIG. 4: Localization of one-dimensional (ID) chiral edge state. Energy dispersion and 
layer-resolved wave function amplitudes of the finite size system corresponding to Fig. To 
obtain the ID chiral edge spectrum, we introduce two parallel zigzag edges in each honeycomb 
layer and stack the corresponding strip structures along the z-axis. Then the resulting system 
possesses two parallel surfaces whose surface normal direction is perpendicular to the z-axis. 
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FIG. 5: Energy dispersion and distribution of localized states of two-dimensional (2D) 
four-band quantum Hall insulator (QHI) bulk bands in a continuum of the three- 
dimensional (3D) normal insulator (NI). Energy dispersion and localization profile of the 
coupled system composed of honeycomb layers stacked along the z-direction. For each model 
system, we plot the layer-resolved wave function amplitudes along a particular direction in the 
momentum space and the 2D distribution of states localized along the z-direction. In each model, 
the Chern number distribution of the four bands on the top surface layer is indicated by a vector 
C = [^1,^25^35^4]- In all cases except the case (b), the two high (low) energy bands with the 
Chern number ni, 712 (^3, 714) are buried in the conduction (valence) band of the 3D NI. In the 
case of (b), the second band with the Chern number 712 = is in the gap. (a) C = [0, 0, —1, +1]. 
(b) C = [-1,0,+1,0]. (c) C = [0,-1, +1,0]. (d) C = [-1,-1,+1,+1]. (e) C= [-1,+1,+1,-1]. 
In all cases, only the 2D bands with nonzero Chern numbers support bound states localized along 

1Q 

the z-direction. 
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FIG. 6: Energy dispersion and distribution of localized states for the two-dimensional 
(2D) quantum Hall insulator (QHI) with Chern number two. Here the Chern numbers of 
the conduction and valence bands of the 2D QHI are -2 and +2, respectively. Notice that there are 
several localized bound states in the 2D Brillouin zone in both the valence and conduction bands 
of the three-dimensional (3D) normal insulator (NI) substrate as shown in the two panels on the 
right. On the left three panels, the dispersion of the coupled heterostructure, which is projected 
to the layers near the top surface of the system, is shown along the Brillouin zone boundary. 
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FIG. 7: The 2D distribution of localized states of the two-dimensional (2D) quantum 
spin Hall insulator (QSHI) bulk bands in three-dimensional (3D) continuum states. 

(a) and (b) corresponds to the case when the 3D bulk breaks the time-reversal symmetry. In (c) 
and (d), the total system preserves the time-reversal symmetry. The z-component of the total 
spin (Sz) is conserved in (a) and (c) while Sz is not conserved in (b) and (d) due to the Rashba- 
type spin mixing term. In all cases, the two high (low) energy bands of the QSHI are buried in 
the conduction (valence) band continuum of the 3D normal insulator (NI). When the 3D bulk 
states break the time-reversal symmetry, there are localized bound states independent of the Sz 
conservation ((a) and (b)). On the other hand, when the total system preserves the time-reversal 
symmetry, localized bound states exist when Sz is conserved ((c)) while all 2D states spread along 
the z-direction when Sz is not conserved ((d)). 
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